Communication System, Terminal Device, Communication Processing Method, Communication Processing Program, Storage Medium Stored With Communication Processing Program.

ABSTRACT

A controller to which a second controller is connected arranges, based on predetermined integrated scenario information defining a first input region allotted for the controller and a second input region allotted for the second controller within data regions for packet input data, operation input data corresponding to an operation input from a user in the first input region, and data based on extended input data obtained from an extension apparatus in the second input region, generates packet input data, and transmits it to a device main unit.

TECHNICAL FIELD

The present invention relates to a communication system, a terminaldevice, a communication processing method, a communication processingprogram, and storage medium stored with the communication processingprogram.

BACKGROUND ART

A communication system for transmitting and receiving informationbetween a game device and a controller through a preset, prescribedcommunication method is well known.

PRIOR ART DOCUMENTS Patent Documents

-   [Patent Document 1] JP 2008-102788A

SUMMARY OF THE INVENTION Problem to be Solved by the Invention

A user wanting to enhance a function of a controller desires to connecta desired extension apparatus to the controller and then use it.

However, in the case of carrying out packet communication of apredetermined type and predetermined capacity between the game deviceand the controller, transmission and reception of information cannot becarried out between the extension apparatus and the game device merelyby connecting the extension apparatus to the controller, thereby notbeing able to use the extension apparatus.

The present invention aims to provide a communication system capable ofusing a desired extension apparatus merely by connecting it to aterminal device for carrying out packet communication of a predeterminedtype and predetermined capacity between an information processing unitand the terminal device.

Means of Solving the Problem

A communication system according to a first aspect of the presentinvention includes an information processing unit, a terminal device,and an extension apparatus. The terminal device transmits packet inputdata to the information processing unit through packet communicationaccording to a predetermined method for which format and capacity areregulated. The extension apparatus is connected to the terminal devicein an attachable and removable manner.

The terminal device includes an operation input means, a packetgeneration means, a storage means, and an extended data reception means.The operation input means receives an operation input from a user. Thepacket generation means makes the operation input data obtained from theoperation input means into a packet so as to generate the packet inputdata. The storage means stores integrated scenario information. Theintegrated scenario information defines a region allotted for theextension apparatus within data regions for the packet input data. Theextended data reception means receives extended data from the connectedextension apparatus.

The packet generation means generates packet input data based on theintegrated scenario information when the extension apparatus isconnected to the terminal device.

A communication system according to a second aspect of the presentinvention includes an information processing unit, a terminal device,and an extension apparatus. An information processing unit transmitspacket output data through packet communication according to apredetermined method for which format and capacity are regulated. Theterminal device receives packet output data from the informationprocessing unit. The extension apparatus is connected to the terminaldevice in an attachable and removable manner.

The terminal device includes a packet data processing means and astorage means. The packet data processing means executes analysisprocessing of the received packet output data. The storage means storesextraction scenario information. The extraction scenario informationdefines a region allotted for the extension apparatus within dataregions for the packet output data.

When the extension apparatus is connected, the packet data processingmeans extracts the extended output data for the extension apparatus fromthe packet output data based on the extraction scenario information, andthen transmits the extracted extended output data to the extensionapparatus.

Result of Invention

According to the present invention, when transmitting and receiving databetween the information processing device and the terminal devicethrough packet communication in a predetermined format and predeterminedcapacity, a desired extension apparatus may be used merely bywire-connecting that extension apparatus to the terminal device.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram schematically showing a communication system as anembodiment of the present invention;

FIG. 2 is a block diagram showing a principal internal structure of adevice main unit;

FIG. 3 is a block diagram showing a principal electrical structure of acontroller;

FIG. 4 is a diagram showing exemplary integrated scenario information;

FIG. 5 is a diagram showing other exemplary integrated scenarioinformation;

FIG. 6 is a diagram showing exemplary extraction scenario information;

FIG. 7 is a flowchart showing extend mode transition processing;

FIG. 8 is a flowchart showing extend mode transition processing;

FIG. 9 is a flowchart showing extend mode processing;

FIG. 10 is a flowchart showing extend mode processing;

FIG. 11 is a diagram showing an example of a controller and a secondcontroller;

FIG. 12 is a diagram showing another example of a controller and asecond controller;

FIG. 13 is a diagram showing another example of a controller and asecond controller;

FIG. 14 is a diagram showing another example of a controller and asecond controller;

FIG. 15 is a diagram showing an example of fundamental input data,extended input data, integrated scenario information, and integratedresults;

FIG. 16 is a diagram showing another example of fundamental input data,extended input data, integrated scenario information, and integratedresults;

FIG. 17 is a diagram showing another example of fundamental input data,extended input data, integrated scenario information, and integratedresults;

FIG. 18 is a diagram showing another example of fundamental input data,extended input data, integrated scenario information, and integratedresults;

FIG. 19 is a diagram showing another example of fundamental input data,extended input data, integrated scenario information, and integratedresults;

FIG. 20 is a diagram showing an extended-in-memory view of a format forintegrated scenario information;

FIG. 21 is a diagram showing a list of attribute values;

FIG. 22 is a diagram showing an example format for integrated scenarioinformation;

FIG. 23 is a diagram illustrating exemplary integration target packets;

FIG. 24 is a diagram illustrating an integration host I/O device;

FIG. 25 is a diagram illustrating post-calculation integration targetpackets;

FIG. 26 is a diagram illustrating an example format for integratedscenario information;

FIG. 27 is a diagram illustrating an example of post-calculationintegration target packets;

FIG. 28 is a diagram illustrating an example format for integratedscenario information;

FIG. 29 is a diagram illustrating post-calculation integration targetpackets;

FIG. 30 is a diagram illustrating an example format for integratedscenario information;

FIG. 31 is a diagram illustrating post-calculation integration targetpackets;

FIG. 32 is a diagram illustrating an example format for integratedscenario information;

FIG. 33 is a diagram illustrating post-calculation integration targetpackets;

FIG. 34 is a diagram illustrating an example format for integratedscenario information;

FIG. 35 is a diagram illustrating post-calculation integration targetpackets;

FIG. 36 is a diagram illustrating integration target packets;

FIG. 37 is a diagram illustrating an integration host I/O device;

FIG. 38 is a diagram illustrating an example format for integratedscenario information; and

FIG. 39 is a diagram illustrating post-calculation integration targetpackets.

MODE FOR CARRYING OUT THE INVENTION

[General Structure of Communication System of this Embodiment]

A communication system as an embodiment of the present invention isschematically illustrated in FIG. 1.

This communication system includes an entertainment device (hereafterreferred to device main unit) 10, which is an exemplary informationprocessing unit (video game device), a controller 20 as a terminaldevice operated by a user (player), a second controller 40, whichfunctions as an attachable and removable extension apparatus that iswire connected to the controller 20 via an extension cable 41, and amonitor device (e.g., television receiver) 100, which is supplied withpicture and sound signals from the device main unit 10. The monitordevice 100 has an image display (display screen) 101 for displaying theimages based on the picture signals supplied from the device main unit10. Note that the removable wire connection between the controller 20and the second controller 40 includes connection by the aforementionedextension cable 41 as well as direct connection between respectiveterminals of the two controllers.

Information is transmitted and received through communication betweenthe device main unit 10 and the controller 20. Communication methodtherebetween may be through either a wireless connection or a wiredconnection via a cable 13. With the controller 20 according to thisembodiment, communication is possible using both wired and wirelessmethods. Wired communication is carried out while the controller 20 iswire connected to the device main unit 10, and wireless communication iscarried out while the wired connection is disconnected.

In the example of FIG. 1, the device main unit 10 has multiplecontroller ports 11 (four ports in this embodiment). In the case ofwire-connecting the controller 20 with the device main unit 10 via thecable 13, the cable 13 has a plug-in connector 12 provided on an endinserted into an arbitrary one of the controller ports 11 of the devicemain unit 10 and electrically connected, and a plug-in connector 14provided on the other end is inserted into a connection port 15 of thecontroller 20 and electrically connected. Note that use of anothercontroller port 11 allows simultaneous wired connections of multiplecontrollers 20 to the device main unit 10. The wired connection methodused between the device main unit 10 and the controller 20 should allowcommunication in both directions, and a universal serial bus (USB)connection is adopted in this embodiment.

Furthermore, the controller 20 is provided with a wireless communicationunit (antenna) 17 for transmitting and receiving information throughwireless communication to and from a wireless communication unit(antenna) 16 of the device main unit 10. There are various communicationmethods that can be applied between the wireless communication units 16and 17 such as a general purpose short-range, high-speed wirelesscommunication method such as Bluetooth™ communication or an exclusiveshort-range, wireless communication method as long as wirelesscommunication is possible therebetween. Bluetooth™ wirelesscommunication (hereafter referred to as BT communication) is adopted inthis embodiment.

During BT communication between the device main unit 10 and thecontroller 10, data is mutually transmitted and received therebetweenthrough packet communication in a predetermined format (e.g., I2Cformat) and capacity (e.g., 48 bytes). Note that data may be receivedthrough packet communication in the above predetermined format andcapacity even with a USB connection. The case of transmitting andreceiving data through packet communication in I2C format and 48 bytesfor both the USB connection and the BT communication is described inthis embodiment.

The second controller 40 may be the same type as the controller 20, orit may be a different type. Furthermore, the second controller 40 may beone that is only usable as an extension apparatus of the controller 20,and cannot be used alone. Moreover, the terminal device may be a device(e.g., portable game console) other than the controller 20, and theextension apparatus may be an input device (e.g., mouse, keyboard,joystick, or the like) or an output device (speaker or the like) otherthan the controller 40. The extension apparatus may also not include theCPU.

In this embodiment, a case using the same type of second controller 40as the controller 20 as the extension apparatus of the controller 20 isexemplified. Note that in the following description, whendifferentiating between components of the controller 20 and those of thesecond controller 40, ‘M’ is attached to the components of thecontroller 20, and ‘E’ is attached to the components of the secondcontroller 40 so as to differentiate them. Furthermore, state of thesecond controller 40 not wire connected to the controller 20 is referredto as fundamental mode, and state of the second controller 40 wireconnected to the controller 20 is referred to as extend mode.

The second controller 40 functions as an extension apparatus for thecontroller 20 in the extend mode. When wire-connecting the controller 20and the second controller 40 using the extension cable 41, a plug-inconnector 42 provided on an end of the extension cable 40 is insertedinto a connection port 18 of the controller 20 and electricallyconnected, and a plug-in connector 43 provided on the other end isinserted into a connection port 18 of the controller 40 and electricallyconnected. Note that the controllers 20 and 40 may be connected byproviding a plug-in connector to the second controller 40 and connectingthis plug-in connector to the connection port 18 of the controller 20.Furthermore, when the second controller 40 and the device main unit 10are capable of direct communication through a wired or wirelessconnection, direct communication therebetween in the extend mode isprohibited.

[Exterior of Device Main Unit]

Aside from the above-mentioned controller ports 11 (11A to 11D) and thewireless communication unit 16, the device main unit 10 is provided witha memory card slot in which a memory card, which includes semiconductormemory, may be inserted/ejected, a disk tray, an open/close button foropening and closing the disk tray, an on/standby/reset button forturning power on, into standby mode, or resetting, an audio-video outputterminal (AV multi-output terminal), a PC card slot, an optical digitaloutput terminal, an IEEE (Institute of Electrical and ElectronicsEngineers) 1394 connection terminal, a power switch, and an AC powerinput terminal not shown in the drawing.

The device main unit 10 is capable of executing a video game based on anapplication program for the video game recorded on a disk medium such asa DVD-ROM or CD-ROM, for example, and reproducing (decoding) video dataand audio data recorded on a DVD or CD.

Note that the above-mentioned application program and video/audio dataare read from not only disk media but also from semiconductor memory andtape media. It may also be supplied from a wired or wireless wide-areaor intra-area communication line.

[Internal Circuit Structure of Device Main Unit]

FIG. 2 shows the principal internal structure of the device main unit10.

As shown in FIG. 2, the device main unit 10 has a main bus 61 and a subbus 62, which are either connected or disconnected from each other via abus interface 63.

A main CPU 64, main memory 65 configured by RAM, a main direct memoryaccess controller (DMAC) 66, and a graphic processing unit (GPU) 68including frame memory 67 are connected to the main bus 61. A CRTcontroller (CRTC) 69, which is a control means for generating videooutput signals, is connected to the GPU 68. An image according to videooutput signals is displayed on a predetermined display unit (the imagedisplay unit 101 of the monitor unit 100 according to this embodiment)connected to the device main unit 10 via a cable or the like.

The main CPU 64 reads a boot program from ROM 70 on the sub bus 62 viathe bus interface 63 once the device main unit 10 starts running,executes that boot program, and executes an operating system.Furthermore, it controls a media drive 71, reads out an applicationprogram or data from a medium 72 loaded into the media drive 71, andstores it in the main memory 65. Moreover, geometric processing iscarried out for various types of data read out from the medium 72, suchas three-dimensional object data (e.g., coordinate values of a polygonvertex (representative point)) configured by multiple primitive figures(polygons). A display list including contents of polygon definitioninformation is generated through the geometric processing. Furthermore,data compressed based on an MPEG (Moving Picture Experts Group) systemor a JPEG (Joint Photographic Experts Group) system is decompressed. Inother words, the main CPU 64 has an information deciphering function fordeciphering information according to a software program.

The polygon definition information includes drawing area settinginformation and polygon information. The drawing area settinginformation includes coordinates of a drawing clipping area forcanceling drawing when offset coordinates of a drawing area in a framebuffer address and coordinates of a polygon outside of the drawing areaexist. The polygon information includes polygon attribute informationand vertex information; wherein the polygon attribute information isinformation specifying shading mode, a blending mode, texture mappingmode, and the like, and vertex information is information of coordinatesof a vertex within the drawing area, coordinates of a vertex within atexture area, and vertex color.

The GPU 68 stores drawing contexts, reads out an appropriate drawingcontext based on identification information of image context included inthe display list informed from the main CPU 64, rendering processing isperformed based thereupon, and a polygon is drawn in the frame memory67. The frame memory 67 may be used as texture memory, and thus a pixelimage in the frame memory 67 may be applied to the polygon drawn astexture.

The main DMAC 66 controls DMA transfer for respective circuits connectedto the main bus 61, and controls DMA transfer for respective circuitsconnected to the sub bus 62 in accordance with status of the businterface 63.

A sub CPU 73 configured by a microprocessor and the like, sub-memory 74configured by RAM, a sub DMAC 75, ROM 70 stored with programs such as anoperating program, a sound processing unit (SPU) 77, which reads outsound data stored in sound memory 76 and outputs it as audio output, aUSB communication module 78, which carries out wired transmission andreception of information to and from the controller 20 through BTcommunication, a BT communication module 79, which carries out wirelesstransmission and reception of information to and from the controller 20through BT communication, a media drive 71 for loading a predeterminedmedium 72, and a keyboard 80 are connected to the sub bus 62. The medium72 is a recording medium such as a CD-ROM or DVD-ROM recorded with aprogram for image processing. The device main unit 10 reads this programfor image processing so as to execute necessary entertainmentprocessing. The USB communication module 78 includes the controllerports 11 (shown in FIG. 1), and the BT communication module 79 includesthe wireless communication unit 16 (shown in FIG. 1).

Furthermore, if either the USB communication module 78 or the BTcommunication module 79 receives a signal from the controller 20, themain CPU 64 generates a display list based on that received signal andoutputs it to the GPU 68.

The sub CPU 73 carries out various operations in accordance with theprogram stored in the ROM 70. The sub DMAC 75 controls DMA transfer forrespective circuits connected to the sub bas 62 only when the businterface 63 is detached from the main bus 61 and the sub bas 62.

When transmitting data from the BT communication module 78 to thecontroller 20, the main CPU 64 executes output data generationprocessing described later so as to generate packet output data. Whenthe BT communication module 78 receives data from the controller 20, themain CPU 64 executes input data analysis processing described later.Note that the output data generation processing and the input dataanalysis processing may be executed by the sub CPU 73.

[Structure of Controller]

FIG. 3 shows the principal electrical structure of the controller 20.

As shown in FIG. 3, the controller 20 includes a CPU 81, ROM 82, RAM 84,a battery 83, an operation input unit 85, an acceleration sensor 87, ashaker 97, a USB communication module 88, and a BT communication module89, which are connected via a bus 90. The operation input unit 85 is ageneral term for various operation buttons (command input button, powerbutton, HOME button, mode switch, and the like) provided on the outersurface of a frame of the controller 20. The shaker 97 is a vibrationgenerating device for vibrating the controller 20.

The USB communication module 88 transmits and receives informationthrough wired communication with the device main unit 10 via a USBconnecting cable, and the BT communication module 89 wirelesslytransmits and receives information with the device main unit 10 throughBT communication. The USB communication module 88 includes theconnection ports 15 and 18 (shown in FIG. 1), and the BT communicationmodule 89 includes the wireless communication unit 17 (shown in FIG. 1).

Note that a USB cable 13 (shown in FIG. 1) connecting the controller 20and the device main unit 10 includes a power line, and with a USBconnection, the device main unit 10 supplies power to the controller 20via the power line and charges the battery 83.

The CPU 81 executes predetermined processing such as start processing,input packet generation processing, signal transmission processing,signal reception processing, and vibration control processing.

The start processing reads a start program from the ROM 82 whenactivating the controller 20 and then executes the start program. Theinput packet generation processing generates packet input data(fundamental packet input data or extended packet input data describedlater) corresponding to an operation input from the user using theoperation input unit 85. The packet input data is usable for thepredetermined format packet communication, which corresponds to thepredetermined capacity 48 bytes and the predetermined format 12C. Thesignal transmission processing transmits the packet input data, which isgenerated through the input packet generation processing, to the devicemain unit 10 from either the USB communication module 88 or the BTcommunication module 89 every predetermined cycle. The signal receptionprocessing makes either the USB communication module 88 or the BTcommunication module 89 receive the packet output data, which istransmitted from the device main unit 10, every predetermined cycle. Thevibration control processing makes the shaker 97 vibrate in accordancewith shake information included in the packet output data that the USBcommunication module 88 or the BT communication module 89 has receivedfrom the device main unit 10. Details of the input packet generationprocessing and the signal reception processing will be described later.

A product ID and scenario information are prestored in the ROM 82 asextension apparatus identification information. The product ID isattribute information for determining and identifying type of device.The scenario information includes integrated scenario information andextraction scenario information.

The second controller 40 has the same basic structure as the controller20. However, the second controller 40 functions as an extensionapparatus of the controller 20 when it is wire-connected to thecontroller 20 in extend mode. In this case, a CPU 81E of the secondcontroller 40 prohibits direct communication with the device main unit10, and transmits an operation signal, which corresponds to an operationinput from the user using an operation input unit 85E, as extended inputdata to the controller 20 from a USB communication module 88E. The USBcommunication module 88E then receives extended output data from thecontroller 20.

Furthermore, when the second controller 40 is wire-connected to thecontroller 20, a CPU 81M of the controller 20 detects the wiredconnection with the second controller 40, and as described later, oncethe extend mode transition processing is executed, processing in theinput packet generation processing and the signal reception processingis changed from processing for fundamental mode to processing for extendmode.

[Description of Extend Mode Transition Processing]

If the second controller 40 is wire-connected to the controller 20, thecontroller 20 and the second controller 40 execute extend modetransition processing so as to make transition from the fundamental modeto the extend mode.

During the extend mode transition processing, the CPU 81E of the secondcontroller 40 reads out the product ID and the scenario information fromROM 82E and transmits them to the controller 20. The controller 20stores the product ID and the scenario information received from thesecond controller 40 in RAM 84M. Note that the controller 20 may deletethe scenario information stored in the RAM 84M when making a transitionfrom the extend mode to the fundamental mode (when the wired connectionbetween the controller 20 and the second controller 40 is released), orthe integrated scenario information may be overwritten and updated whenmaking a transition to the extend mode without deleting the scenarioinformation when making a transition to the fundamental mode. Moreover,the controller 20 may also transmit the scenario information obtainedfrom the controller 40 to the device main unit 10.

The controller 20 also transmits to the device main unit 10 through BTcommunication the product ID of the second controller 40 and extensionapparatus connection information indicating that the second controller40 is connected.

During the extend mode transition processing, the CPU 81E of the secondcontroller 40 prohibits direct communication with the device main unit10 and transmits an operation signal, which corresponds to an operationinput from the user using the operation input unit 85E, to thecontroller 20 from the USB communication module 88E.

[Description of Input Packet Generation Processing]

The input packet generation processing executed by the CPU 81M of thecontroller 20 includes fundamental packet input data generationprocessing during fundamental mode and extended packet input datageneration processing during extend mode.

During the fundamental packet input data generation processing, theobtained operation input data in accordance with operation input fromthe user using an operation input unit 85M of the controller 20 isconverted into packets so as to generate fundamental packet input datain the predetermined format 12C with the predetermined capacity of 48bytes. The generated fundamental packet input data is then transmittedto the device main unit 10 through the signal transmission processing.

During the extended packet input data generation processing, extendedpacket input data including data based on the extended input datareceived from the controller 40 is generated in accordance with theintegrated scenario information obtained from the second controller 40.The generated, extended packet input data is then transmitted to thedevice main unit 10 through the signal transmission processing. Notethat this extended packet input data always includes the aforementionedextension apparatus connection information.

The integrated scenario information defines regions allotted for theextended input data (hereafter referred to as extended input regions)and regions not allotted to the extended input data (hereafter referredto as original input regions) of data regions for packet input data,extended input regions corresponding to individual extended input data,and integration regulations for the fundamental packet input data andthe extended packet input data. The integration regulations arestipulated for the respective data regions and include processing ofdestroying extended input data (hereafter referred to as processing ofmaintaining the original input data) while leaving the fundamentalpacket input data (hereafter referred to as original input data),processing of updating the original input data with the extended inputdata (hereafter referred to as processing of replacing the originalinput data with the extended input data), and processing of integratingthe original input data and the extended input data (hereafter referredto as processing of merging the original input data and the extendedinput data). The processing of maintaining the original input data isset in the original input regions, and either the processing ofreplacing the original input data with the extended input data or theprocessing of merging the original input data and the extended inputdata is set in the extended input regions. The processing of mergingleaves the original input data when that data is written in the extendedinput regions, and writes the original input data when it has not beenwritten therein, for example.

FIG. 4 shows exemplary integrated scenario information. FIG. 4 showsthat 38 consecutive bytes from the first colored byte to the 38th byteof 48-byte data regions make up original input regions, and eightconsecutive bytes from the non-colored 39th byte to the 48th byte makeup extended input regions. It shows that the processing of replacing theoriginal input data with the extended input data is executed in regions(Rp01 to Rp06) of the 39th byte, 40th byte, 43rd byte, and from 46th to48th bytes, and the processing of merging the original input data andthe extended input data is executed in regions (Mg01 to Mg04) of the41st byte, 42nd byte, 44th byte, and 45th byte.

FIG. 5 shows other exemplary integrated scenario information. Thisexample shows extended input regions set non-consecutively, and as inFIG. 4, colored regions are original input regions, and non-coloredregions are extended input regions. It also shows that the processing ofreplacing the original input data with the extended input data isexecuted in regions (Rp01 to Rp06) of the 18th byte, 22nd byte, 27thbyte, 37th byte, 43rd byte, and 48th byte, and the processing of mergingthe original input data and the extended input data is executed inregions (Mg01 to Mg04) of the 24th byte, 25th byte, 28th byte, and 31stbyte.

Capacity (number of bytes) of the extended input regions is set inconformity with the type of extension apparatus. The extended inputregions are set with precedence from unused regions, which are not usedfor the controller 20, of the fundamental packet input data regions, andwhen there are no unused regions or only the unused regions areinsufficient, they are set by appropriately selecting from regions thatare infrequently used for the controller 20 or regions in which data ofinconsequential information is arranged.

Even when using the same extension apparatus, different integratedscenario information may be used in conformity with an applicationprogram executed by the device main unit 10. For example, in the case ofexecuting a game application program for a game which is moreinteresting as more input operations from the controller 40 are carriedout, the integrated scenario information for which extended inputregions are widely set should be used, and in the case of executing agame application program for a game which is greatly interesting evenwith few input operations from the controller 40, the integratedscenario information for which extended input regions are narrowly setshould be used. In this case, multiple pieces of integrated scenarioinformation should be prestored in the second controller 40, so as forthe controller 20 to select and determine integrated scenarioinformation obtained from the second controller 40 and used inaccordance with the application program executed by the device main unit10.

In this embodiment, fundamental input data corresponding to the packetcommunication method is generated by arranging the operation input datain the original input regions, extended input data corresponding to thepacket communication method is generated by arranging the extended inputdata in the extended input regions, and the generated fundamental inputdata and the extended input data are integrated, generating extendedpacket input data.

For example, in the case of using the integrated scenario informationshown in FIG. 4, fundamental input data is generated by arranging theoperation input data in the same manner as in the fundamental packetinput data generation processing, extended input data is generated byarranging the extended input data in the regions from the 39th byte tothe 48th byte, and the fundamental input data and the extended inputdata are then integrated. During this integration, the fundamental inputdata in the regions (the original input regions) from the first byte tothe 38th byte is maintained as is. In the regions (Rp01 to Rp06) of the18th byte, 22nd byte, 27th byte, 37th byte, 43rd byte, and 48th byte,the fundamental input data is replaced by the extended input data. Inthe regions (Mg01 to Mg04) of the 24th byte, 25th byte, 28th byte, and31st byte, the fundamental input data is merged with the extended inputdata.

Note that the integration regulations for the fundamental packet inputdata and the extended packet input data are for all of the data regionsfor the fundamental packet input data (fundamental input data) asdescribed above, and may also be regulated for just the extended inputregions.

[Description of Signal Reception Processing]

The signal reception processing executed by the CPU 81M of thecontroller 20 includes fundamental reception processing in fundamentalmode and extended reception processing in extend mode.

During the fundamental reception processing, the packet output datareceived from the device main unit 10 is treated as output informationto the controller 20. For example, in the case where the received packetoutput data includes shake information, shake processing is executed inconformity with that shake information, and a shaker 97M is vibrated.

During the extended reception processing, the extended output data isextracted from the packet output data received from the device main unit10 in conformity with the extraction scenario information obtained fromthe second controller 40, and the extracted extended output data istransmitted to a USB communication module E of the second controller 40from a USB communication module 88M. For example, in the case where thereceived extraction output data includes shake information, a CPU 81E ofthe second controller 40 executes shake processing in conformity withthat shake information so as to make a shaker 97E vibrate.

The extraction scenario information specifies regions (hereafterreferred to as extended output regions) for which the extended outputdata is allotted and regions (hereafter referred to as original outputregions) for which extended output data is not allotted of data regionsfor the packet output data.

FIG. 6 shows exemplary extraction scenario information. FIG. 6 showsthat eight consecutive bytes from the first colored byte to the eighthbyte of 48-byte data regions make up original output regions, and 40consecutive bytes (Ex01 to Ex40) from the non-colored ninth byte to the48th byte make up extended output regions.

Capacity (number of bytes) of the extended output regions is set inconformity with the type of extension apparatus. The extended outputregions are set with precedence from unused regions, which are not usedfor the controller 20, of the packet output data regions, and when thereare no unused regions or only the unused regions are insufficient, theyare set by appropriately selecting from regions that are infrequentlyused for the controller 20 or regions in which data of inconsequentialinformation is arranged. For example, in the case of an extensionapparatus with a relatively large amount of output information such as aspeaker, the extended input region should be set wide.

Even when using the same extension apparatus, different extractionscenario information may be used in conformity with an applicationprogram executed by the device main unit 10.

[Description of Output Data Generation Processing and Input DataAnalysis Processing]

The main CPU 64 of the device main unit 10 judges that the controller 20is in extend mode when data received from the controller 20 is extendedpacket input data (when the received data includes extension apparatusconnection information). If it is judged to be in extend mode, packetoutput data according to type of extension apparatus wire-connected tothe controller 20 is generated based on the product ID received from thecontroller 20. An extended data storage region of the packet output datato be generated matches extended data storage region of the extractionscenario information used by the controller 20. For example, when anextension apparatus stored with the extraction scenario information ofFIG. 6 is connected, the ninth byte to the 48th byte (Ex01 to Ex40) areextended output regions, and the extended output data for the extensionapparatus is arranged in the extended output regions.

Moreover, the main CPU 64 of the device main unit 10 executes analysisprocessing of the packet input data received from the controller 20.Note that when a program (e.g., a game application program) executed bythe main CPU 64 is preset so as to be executed with distinction betweennormal mode and extend mode, the main CPU 64 executes processingaccording to judgment result of whether or not the controller 20 is inextend mode in conformity with the aforementioned program.

[Description of Extend Mode Transition]

Processing of the entire system during extend mode transition isdescribed next in chronological order.

As shown in FIG. 7, if the second controller 40 is wire-connected to thecontroller 20 during power up, the controller 20 detects this connection(step S1), and requests the second controller 40 for transmission ofscenario information (step S2). The second controller 40 receives thisrequest (step S3), transmits the scenario information to the controller20 (step S4), and the controller 20 then stores the received scenarioinformation in the RAM 84M (step S5).

The device main unit 10 and the controller 20 carry out transmission andreception through packet communication in a predetermined periodiccycle. Upon detection of the connection to the second controller 40, thecontroller 20 adds extension apparatus connection information to thepacket input data, and transmits the entirety to the device main unit10. The device main unit 10 that has received the packet input dataincluding the extension apparatus connection information requests thecontroller 20 for acquisition of attribute information including theproduct ID of the connected extension apparatus, as shown in FIG. 8(step S10). The controller 20 receives this request (step S11) andrequests the second controller 40 for transmission of the attributeinformation (step S12). The second controller 40 receives this request(step S13) and transmits its own attribute information to the controller20 (step S14).

The controller 20 that has received the attribute information from thesecond controller 20 stores this information as buffer values in the RAM84M (step S15). The device main unit 10 that has requested acquisitionof the attribute information then requests the controller 20 fortransmission of the attribute information (step S20). The controller 20that has stored the attribute information of the second controller 40answers the request from the device main unit 10 (step S21) andtransmits the stored attribute information to the device main unit 10(step S22). The device main unit 10 that has received the attributeinformation stores it in a storage unit such as the main memory 65 orthe sub-memory 74 (step S23). Note that the device main unit 10 that hasstored the attribute information requests the controller 20 forinitialization of the second controller 40, commands the controller 20to initialize the second controller 40 in accordance with the request,and the second controller 40 then executes initialization processing inconformity with the command from the controller 20.

[Description of Extend Mode]

When the controller 20 is in extend mode, the device main unit 10generates packet output data according to type of extension apparatus(second controller 40) wire-connected to the controller 20 based on theproduct ID received from the controller 20 and stored, and then outputsit to the controller 20. The controller 20 that has received the packetoutput data executes the extended reception processing. In other words,as shown in FIG. 9, the extended output data is extracted from thereceived packet output data in accordance with the extraction scenarioinformation obtained from the second controller 40 (step S30), and theextracted extended output data is then transmitted to the secondcontroller 40 (step S31). The second controller 40 executes processingin accordance with the received extended output data.

Moreover, the controller 20 executes the extended packet input datageneration processing. In other words, as shown in FIG. 10, fundamentalinput data corresponding to the packet communication method is generatedby arranging the operation input data in the original input regions inconformity with the integrated scenario information obtained from thesecond controller 40 (step S40), extended input data corresponding tothe packet communication method is generated by arranging the extendedinput data in the extended input regions (step S41), the generatedfundamental input data and the extended input data are integrated,generating extended packet input data (step S42), and the generatedextended packet input data is then transmitted to the device main unit10 (step S43). The device main unit 10 executes analysis processing ofthe extended packet input data.

For example, it is possible to wire-connect the second controller 40 tothe controller 20, grip the controller 20 with the left hand and performoperation inputs with a left finger, and grip the second controller 40with the right hand and perform operation inputs with a right finger. Inother words, the two controllers 20 and 40 may be used simultaneously,one for the right hand and the other for the left hand.

Moreover, the two controllers 20 and 40 may be used as a single unitcontroller during execution of a confrontational game applicationprogram by processing such as transmitting shake information to thecontroller 20 (arranging shake information in an original output region)when a left hand input operation is inappropriate, and by transmittingshake information to the second controller 40 (arranging shakeinformation in an extended output region) when a right hand inputoperation is inappropriate is possible.

Furthermore, in the case where a specialized exclusive controller forthe game application program to be executed is provided, and theexclusive controller does not have a BT communication function, thecontroller 20 may be used as a BT communication apparatus for theexclusive controller by connecting an exclusive controller as anextension apparatus of the controller 20.

Next, various aspects of the controller 20, the second controller, andthe scenario information are exemplified. The controller 20 of each ofthe examples shares the same basic structure including a left operationpart 21, a right operation part 22, a left stick 23L, a right stick 23R,an L1 button 24 a, an L2 button 24 b, an R1 button 25 a, an R2 button 25b, a home button 26, and other related parts, as shown in FIG. 11. Theleft operation part 21 has directional command buttons (right button 21a, left button 21 b, up button 21 c, and down button 21 d), which arestamped with upward, rightward, downward, and leftward marks,respectively. The right operation part 22 includes four command buttons(triangle display button 22 a, circle display button 22 b, X displaybutton 22 c, and square display button 22 d). The left stick 23L and theright stick 23R are capable of tilt operations and orbit operations, andreturn to neutral positions and maintained when not being operated.

[Application 1]

A second controller 40A of this example is directly connected to thecontroller 20 and has larger circle display extension button 45 and Xdisplay extension button 46 than the circle display button 22 b and theX display button 22 c of the controller 20, as shown in FIG. 11. Thesecond controller 40A is favorably used for quiz games where answers tosubmitted questions are input by pressing one of two buttons, forexample.

An example of fundamental input data of the controller 20, extendedinput data of the second controller 40A, integrated scenarioinformation, and integrated results of the case where the secondcontroller 40A is mounted on the controller 20 is given in FIG. 15. Theintegrated scenario information of FIG. 15 indicates merging of data inan extended input data address (0x008, +00) with that in a fundamentalinput data address (0x010, +00), and merging of data in an extendedinput data address (0x008, +01) with that in a fundamental input dataaddress (0x010, +01). The fundamental input data address (0x010, +00) isa data region in which information of a press operation of the X displaybutton 22 c of the controller 20 is written, and the extended input dataaddress (0x008, +00) is a data region in which information of a pressoperation of the X display extension button 46 of the second controller40A is written. Moreover, the fundamental input data address (0x010,+01) is a data region in which information of a press operation of thecircle display button 22 b of the controller 20 is written, and theextended input data address (0x008, +01) is a data region in whichinformation of a press operation of the circle extension displayextension button 45 of the second controller 40A is written.

In the extend mode using such a second controller 40A and the integratedscenario information, a press operation of either the circle displaybutton 22 b or the circle display extension button 45 is treated thesame as that of the circle display button 22 b in normal mode, and apress operation of either the X display button 22 c or the X displayextension button 46 is treated the same as that of the X display button22 c in normal mode. Accordingly, the user can perform an arbitrarypress operation of the more easy-to-navigate button of either the circledisplay button 22 b or the circle display extension button 45, and canperform an arbitrary press operation of the more easy-to-navigate buttonof either the X display button 22 c or the X display extension button46. Moreover, there is no need for the device main unit 10 to determinewhich of the circle display button 22 b or the circle display extensionbutton 45 has been operated, and which of the X display button 22 c orthe X display extension button 46 has been operated.

[Application 2]

A second controller 40B of this example is directly connected to thecontroller 20 and has an extension stick 47, as shown in FIG. 12.

An example of fundamental input data of the controller 20, extendedinput data of the second controller 40B, integrated scenarioinformation, and integrated results of the case where the secondcontroller 40B is mounted on the controller 20 is given in FIG. 16. Theintegrated scenario information of FIG. 16 indicates replacing the datain a fundamental input data address (0x018, +00) with that in anextended input data address (0x008, +00), and replacing the data in afundamental input data address (0x018, +01) with that in an extendedinput data address (0x008, +01). The fundamental input data addresses(0x018, +00) and (0x018, +01) are both empty data regions, and theextended input data addresses (0x008, +00) and (0x008, +01) are bothdata regions in which information of an operation of the extension stick47 of the second controller 40B is written. In other words, extendedpacket input data resulting from adding operation information of theextension stick to the fundamental input data is generated.

Since in the extend mode using such a second controller 40B and theintegrated scenario information, operation inputs of the extension stick47 are added to the operations in the normal mode, operation inputs maybe diversified.

[Application 3]

The second controller 40B of this example is the same as in application3, and is directly connected to the controller 20 and has the extensionstick 47, as shown in FIG. 12.

An example of fundamental input data of the controller 20, extendedinput data of the second controller 40B, integrated scenarioinformation, and integrated results of the case where the secondcontroller 40B is mounted on the controller 20 is given in FIG. 17. Theintegrated scenario information of FIG. 17 indicates replacing the datain a fundamental input data address (0x008, +04) with that in anextended input data address (0x008, +00), and replacing the data in afundamental input data address (0x018, +05) with that in an extendedinput data address (0x008, +01). The fundamental input data addresses(0x008, +04) and (0x008, +05) are both data regions in which informationof an operation of the left stick 23L of the controller 20 is written,and the extended input data addresses (0x008, +00) and (0x008, +01) areboth data regions in which information of an operation of the extensionstick 47 of the second controller 40B is written.

Since in the extend mode using such a second controller 40B and theintegrated scenario information, operation of the left stick 23L isreplaced by operation of the extension stick 47. Note that in this case,information of operations of the left stick 23L is not transmitted tothe device main unit 10.

[Application 4]

A second controller 40C of this example is directly connected to thecontroller 20 and has the circle display extension button 45, the Xdisplay extension button 46, the extension stick 47, an L1 button 48, anL2 button 49, an R1 button 50, and an R2 button 51, as shown in FIG. 13.Note that the controller 20 does not have an L1 button, an L2 button, anR1 button and an R2 button.

An example of fundamental input data of the controller 20, extendedinput data of the second controller 40C, integrated scenarioinformation, and integrated results of the case where the secondcontroller 40C is mounted on the controller 20 is given in FIG. 18. Theintegrated scenario information of FIG. 18 indicates merging of the datain the extended input data address (0x008, +00) with that in thefundamental input data address (0x010, +00), merging of data in theextended input data address (0x008, +01) with that in the fundamentalinput data address (0x010, +01), replacing data in a fundamental inputdata address (0x010, +04) with that in an extended input data address(0x008, +04), replacing data in a fundamental input data address (0x010,+05) with that in an extended input data address (0x008, +05), replacingdata in a fundamental input data address (0x010, +06) with that in anextended input data address (0x008, +06), replacing data in afundamental input data address (0x010, +07) with that in an extendedinput data address (0x008, +07), replacing data in a fundamental inputdata address (0x018, +00) with that in an extended input data address(0x008, +02), and replacing data in a fundamental input data address(0x018, +01) with that in an extended input data address (0x008, +03).

The fundamental input data address (0x010, +00) is a data region inwhich information of a press operation of the X display button 22 c ofthe controller 20 is written, and the extended input data address(0x008, +00) is a data region in which information of a press operationof the X display extension button 46 of the second controller 40A iswritten. The fundamental input data address (0x010, +01) is a dataregion in which information of a press operation of the circle displaybutton 22 b of the controller 20 is written, and the extended input dataaddress (0x008, +01) is a data region in which information of a pressoperation of the circle extension display extension button 45 of thesecond controller 40A is written. The fundamental input data addresses(0x010, +04), (0x010, +05), (0x010, +06), and (0x010, +07) are all emptydata regions. The extended input data addresses (0x008, +04), (0x008,+05), (0x008, +06), and (0x008, +07) are data regions in whichinformation of press operations of the extension stick 47, the L1 button48, the R1 button 50, the L2 button 49, and the R2 button 51 of thesecond controller 40B are written. The fundamental input data addresses(0x018, +00) and (0x018, +01) are both empty data regions, and theextended input data addresses (0x008, +02) and (0x018, +03) are bothdata regions in which information of an operation of the extension stick47 of the second controller 40C is written.

In the extend mode using such a second controller 40C and the integratedscenario information, a press operation of either the circle displaybutton 22 b or the circle display extension button 45 is treated thesame as that of the circle display button 22 b in normal mode, and apress operation of either the X display button 22 c or the X displayextension button 46 is treated the same as that of the X display button22 b in normal mode. Moreover, operation inputs of the extension stick47, the L1 button 48, the L2 button 49, the R1 button 50, and the R2button 51 are added to the operations in the normal mode.

[Application 5]

A second controller 40D of this example is a drum-type controllerconnected to the controller 20 via an extension cable 41, and has a tophead 52 that is hit using a stick 53 or the like by the user, as shownin FIG. 14. The second controller 40 detects beating on the top head 52and outputs a corresponding signal. This second controller 40D isfavorably used for a game of entering a rhythm to music, for example.

An example of fundamental input data of the controller 20, extendedinput data of the second controller 40D, integrated scenarioinformation, and integrated results of the case where the secondcontroller 40D is mounted on the controller 20 is given in FIG. 19. Theintegrated scenario information of FIG. 19 indicates replacing pieces ofdata in fundamental input data addresses (0x000, +00), (0x000, +01),(0x000, +02), (0x000, +03), (0x000, +04), (0x000, +05), (0x000, +06),(0x000, +07), (0x008, +00), (0x008, +01), and (0x008, +02) with those inextended input data addresses (0x000, +00), (0x000, +01), (0x000, +02),(0x000, +03), (0x000, +04), (0x000, +05), (0x000, +06), (0x000, +07),(0x008, +00), (0x008, +01), and (0x008, +02), respectively. Thefundamental input data addresses (0x000, +00), (0x000, +01), (0x000,+02), (0x000, +03), (0x000, +04), (0x000, +05), (0x000, +06), and(0x000, +07) are data regions in which setup information (e.g., productID) of the controller 20 is written, and the extended input dataaddresses (0x000, +00), (0x000, +01), (0x000, +02), (0x000, +03),(0x000, +04), (0x000, +05), (0x000, +06), and (0x000, +07), and (0x008,+00) and (0x008, +01) are data regions in which setup information (e.g.,product ID) of the controller 40D is written. The fundamental input dataaddresses (0x008, +00), (0x008, +01), and (0x008, +02) are data regionsin which information of press operations of the X display button 22 c,the circle display button 22 c, the square display button 22 d of thecontroller 20 are written, respectively, and the extended input dataaddresses (0x008, +00), (0x008, +01), and (0x008, +02) are data regionsin which input information (e.g., information regarding a beating input)for the controller 40D is written.

Since in the extend mode using such a second controller 40D and theintegrated scenario information, press operations of the X displaybutton 22 c, the circle display button 22 c, the square display button22 d in normal mode are replaced by input operations of the controller40D.

Moreover, all of the setup information of the controller 20 is replacedwith setup information of the second controller 40D. As a result, thedevice main unit 10 is in a state of actually carrying out communicationwith the controller 20 while recognizing the second controller 40 as acommunication partner. In other words, the controller 20 functions onlyas a wireless communication means (BT communication apparatus) of thesecond controller 40D.

[Description of Basic Format of Integrated Scenario Information]

A basic format of integrated scenario information is described next.FIG. 20 is a expanded-in-memory view of a format for the integratedscenario information.

As shown in FIG. 20, the integrated scenario information is made in asingle unit or multiple units of a basic format when the basic formatcomprises the single unit. The basic format of the single unit isstructured by a combination of ‘attribute value’, ‘integration targetpacket internal first address’, ‘integration host I/O device firstaddress’, ‘trial count’, and ‘parameter’. In the above embodiment, thecontroller (terminal device) 20 is an integration target device, and thesecond controller (extension apparatus) 40 is an integration hostdevice. Integrated scenario information is regulated by setting anarbitrary scenario defining region in accordance with the structure ofthe basic format. Setting of the integrated scenario information of asingle unit as a basic unit in this manner allows various compositionssuch as a combined composition with a different attribute value,integration and mask processing with an arbitrary parameter, and thelike.

Note that while transmission target and host is limited to packet andI/O devices such as a packet internal address or an I/O device apparatusin the following description, they may be arbitrary memory space orarbitrary I/O space.

[Description of Attribute Values]

An attribute value included in the integrated scenario information inthe basic format is a parameter defining what type of integrationprocessing to execute for information within the integration targetpacket internal address, and examples thereof are shown in FIG. 21.Processing defined by attribute values (parameters) includes types suchas Merge, Replace, and Mask. Examples of merge (Mg), replace (Rp), And(Mask processing), Or (Mask processing), Not (Mask processing), and Fill(Fil) are described next.

[Example of Merge (Mg)]

Integrated scenario information (1 unit) of this example is attributevalue 0x01 (Mg), integration target packet internal address 0x05,integration host I/O device address 0x10, trial count 0x01, andparameter 0x00 (not yet determined). The format structure(expanded-in-memory view) of the integrated scenario information is setas in FIG. 22, and the integration target packet and integration hostI/O device are as shown in FIG. 23 and FIG. 24, respectively. Note thatFIG. 24 illustrates the case where button information is 0x44.

During the integration processing, an ORed value of the integrationtarget packet (information (0x23) in address 0x05) and the integrationhost I/O device (information (0x44) in address 0x10) is calculated,resulting in 0x67. This value is the integration target packet addressand is stored in address 0x05. Since the trial count is set to 0x01 inthis example, the integration processing ends here, resulting in apost-calculation integration target packet as shown in FIG. 25. Notethat when the trial count is set to a value of 0x02 or greater, theintegration host and integration target addresses are incremented, andthe same processing is repeated. Moreover, since processing when thetrial count is set to a value of 0x02 or greater is the same in therespective examples of Replace (Rp), And (Mask processing), Or (Maskprocessing), Not (Mask processing), and Fill (Fil) described next,description thereof is omitted.

[Example of Replace (Rp)]

Integrated scenario information (1 unit) of this example is attributevalue 0x02 (Rp), integration target packet internal address 0x05,integration host I/O device address 0x10, trial count 0x01, andparameter 0x00 (not yet determined). The format structure(expanded-in-memory view) of the integrated scenario information is setas in FIG. 26, and the integration target packet and integration hostI/O device are the same as in the above Merge example as shown in FIG.23 and FIG. 24, respectively.

During the integration processing, the integration target packet(information (0x23) in address 0x55) is replaced with the integrationhost I/O device (information (0x44) in address 0x10), and information inthe integration target packet address (address 0x05) is 0x44. Since thetrial count is set to 0x01 in this example, the integration processingends here, resulting in a post-calculation integration target packet asshown in FIG. 27.

[Example of and (Mask Processing)]

Integrated scenario information (1 unit) of this example is attributevalue 0x03 (And), integration target packet internal address 0x05,integration host I/O device address 0x00 (not yet determined), trialcount 0x01, and parameter 0x55. The format structure (expanded-in-memoryview) of the integrated scenario information is set as in FIG. 28, andthe integration target packet is the same as in the above Merge exampleas shown in FIG. 23.

During the integration processing, an AND calculation (0x23 and 0x55) ofthe integration target packet (information (0x23) in address 0x05) andthe parameter value (0x55) in the scenario is performed, and the result(0x01) is stored in the integration target packet (address 0x05). Sincethe trial count is set to 0x01 in this example, the integrationprocessing ends here, resulting in a post-calculation integration targetpacket as shown in FIG. 29.

[Example of or (Mask Processing)]

Integrated scenario information (1 unit) of this example is attributevalue 0x04 (Or), integration target packet internal address 0x05,integration host I/O device address 0x00 (not yet determined), trialcount 0x01, and parameter 0x55. The format structure (expanded-in-memoryview) of the integrated scenario information is set as in FIG. 30, andthe integration target packet is the same as in the above Merge exampleas shown in FIG. 23.

During the integration processing, an OR calculation (0x23 or 0x55) ofthe integration target packet (information (0x23) in address 0x05) andthe scenario parameter (0x55) is performed, and the result (0x77) isstored in the integration target packet (address 0x05). Since the trialcount is set to 0x01 in this example, the integration processing endshere, resulting in a post-calculation integration target packet as shownin FIG. 31.

[Example of not (Mask Processing)]

Integrated scenario information (1 unit) of this example is attributevalue 0x05 (Not), integration target packet internal address 0x05,integration host I/O device address 0x00 (not yet determined), trialcount 0x01, and parameter 0x55.

The format structure (expanded-in-memory view) of the integratedscenario information is set as in FIG. 32, and the integration targetpacket is the same as in the above Merge example as shown in FIG. 23.

During the integration processing, a NOT calculation (0x23 not 0x55) ofthe integration target packet (information (0x23) in address 0x05) andthe scenario parameter (0x55) is performed, and the result (0x88) isstored in the integration target packet (address 0x05). Since the trialcount is set to 0x01 in this example, the integration processing endshere, resulting in a post-calculation integration target packet as shownin FIG. 33.

[Example of Fill (Fill Processing)]

Integrated scenario information (1 unit) of this example is attributevalue 0x06 (Fill), integration target packet internal address 0x05,integration host I/O device address 0x00 (not yet determined), trialcount 0x01, and parameter 0x55. The format structure (expanded-in-memoryview) of the integrated scenario information is set as in FIG. 34, andthe integration target packet is the same as in the above Merge exampleas shown in FIG. 23.

During the integration processing, the integration target packet(information (0x23) in address 0x05) is replaced by the scenarioparameter (0x55), and the result (0x55) is stored in the integrationtarget packet (address 0x05). Since the trial count is set to 0x01 inthis example, the integration processing ends here, resulting in apost-calculation integration target packet as shown in FIG. 35.

[Application]

Next, an example of receiving from the extension apparatus (integrationhost I/O device) input information (address 0x00) of the circle displaybutton 22 b and input information (address 0x01) of the X display button22 not existing in the integration target packet and then executing themerge (integration) processing in the case where the second controller(extension apparatus) 40 has the circle display button 22 b and the Xdisplay button 22 c but the controller (terminal device) 20 isdescribed. In this example, when the extension apparatus is connected,information of the respective integration target packets L1, L2, L3, R1,R21 and R3 are processed so as to be in an OFF state (0x00). Theintegration target packet and the integration host I/O device are asshown in FIGS. 36 and 27, and the format structure (expanded-in-memoryview) of the integrated scenario information is set as in FIG. 38. Notethat FIG. 37 shows the case where both the circle display button 22 band the X display button 22 c are depressed (both button information isON).

In the processing in accordance with a defined scenario of the firstunit of FIG. 38 during the integration processing, information(information (O (ON) in address 0x10) of the integration host I/O deviceand information (x (ON)) in address 0x11 that have undergone mergeprocessing are stored in integration target packets (addresses 0x00 and0x01). Details of storage and calculations are as follows.

(1) Integration target packet address (0x00)=[information in oldintegration target packet address (0x00)] OR [information of integrationhost I/O device (address 0x10 (O (ON)))(2) Integration target packet address (0x01)=[information in oldintegration target packet address (0x01)] OR [information of integrationhost I/O device (address 0x11 (x (ON))]

In the second scenario (scenario defined for the subsequent unit), sinceattribute value is Fill, integration target packet first address orprocessing target is (address 0x08), trial count is 0x06, and parameteris 0x00, the following may be replaced:

(3) integration target packet address (0x08)=0x00(4) integration target packet address (0x09)=0x00(5) integration target packet address (0x0A)=0x00(6) integration target packet address (0x0B)=0x00(7) integration target packet address (0x0C)=0x00(8) integration target packet address (0x0D)=0x00

As a result of the above processing, latest information of theintegration target packet as shown in FIG. 39 is generated.

As described above, according to this embodiment, the user wanting toextend function of the controller 20 by transmitting and receiving datato and from the device main unit 10 through packet communication in apredetermined format and predetermined capacity may use a desiredextension apparatus merely by wire-connecting that extension apparatusto the controller 20.

<Modification>

While the above embodiment, the controller 20 obtains scenarioinformation from the second controller 40, the scenario information maybe obtained from another apparatus.

For example, scenario information may be prestored in the device mainunit 10, an application program to be executed by the device main unit10, a network server to which the device main unit 10 is connected, orthe like. Alternatively, the scenario information may be stored for eachtype of extension apparatus. In the case where the scenario informationis stored in the device main unit 10 or an application program for eachtype of extension apparatus, during transition to extend mode, thedevice main unit 10 obtains the product ID of the second controller 40from the controller 20, identifies scenario information corresponding tothe product ID of the second controller 40 in multiple pieces ofscenario information provided, and transmits it to the second controller40. In the case where the scenario information is stored in each type ofextension apparatus such as a network server, the device main unit 10obtains the scenario information corresponding to the product ID of thesecond controller 40 via the network and then transmits it to the secondcontroller 40.

Note that the descriptions of the respective embodiments given above aremerely examples of the present invention. Therefore, the presentinvention is not limited to the respective embodiments given above, andit is needless to say that various changes may be made without departingfrom the spirit or scope of the present invention.

INDUSTRIAL APPLICABILITY

The present invention may be applied to a communication system fortransmitting and receiving data through packet communication.

DESCRIPTION OF REFERENCE NUMERALS

-   10: device main unit, 20: controller, 40: second controller

1. A communication system comprising: an information processing unit; aterminal device for transmitting packet input data to the informationprocessing unit through packet communication according to apredetermined method for which format and capacity are regulated; and anextension apparatus connected to the terminal device in an attachableand removable manner, wherein the terminal device comprises an operationinput means for receiving an operation input from a user, a packetgeneration means for making the operation input data obtained from theoperation input means into a packet so as to generate the packet inputdata, a storage means for storing integrated scenario informationdefining a region allotted for the extension apparatus within dataregions for the packet input data, and an extended data reception meansfor receiving extended input data from the connected extensionapparatus, and the packet generation means generates the packet inputdata based on the integrated scenario information when the extensionapparatus is connected to the terminal device.
 2. The communicationsystem of claim 1, wherein the integrated scenario information defines afirst input region allotted for the terminal device and a second inputregion allotted for the extension apparatus within data regions for thepacket input data, and the packet generation means, when the extensionapparatus is connected to the terminal device, arranges the operationinput data in the first input region defined in the integrated scenarioinformation, arranges data based on the extended input data in thesecond input region defined in the integrated scenario information, andthen generates the packet input data.
 3. The communication system ofclaim 2, wherein the packet generation means, when the extensionapparatus is connected to the terminal device, generates fundamentalinput data corresponding to the predetermined method by arranging theoperation input data in the first input region, generates extended inputdata corresponding to the predetermined method by arranging the extendedinput data in the second input region, and the integrates thefundamental input data and the extended input data, thereby generatingthe packet input data.
 4. The communication system of claim 1, whereinthe integrated scenario information is prestored in the extensionapparatus, and the terminal device obtains integrated scenarioinformation from the extension apparatus when the extension apparatus isconnected thereto.
 5. A communication system comprising: an informationprocessing unit for transmitting packet output data through packetcommunication according to a predetermined method for which format andcapacity are regulated; a terminal device for receiving packet outputdata from the information processing unit; and an attachable andremovable extension apparatus connected to the terminal device, whereinthe terminal device comprises a packet data processing means forexecuting analysis processing of the received packet output data and astorage means for storing extraction scenario information defining aregion allotted for the extension apparatus within data regions for thepacket output data, and when the extension apparatus is connected, thepacket data processing means extracts the extended output data for theextension apparatus from the packet output data based on the extractionscenario information, and then transmits the extracted extended outputdata to the extension apparatus.
 6. The communication system of claim 5,wherein the extension apparatus is prestored with extension apparatusidentification information capable of specifying at least its own type,the terminal device obtains extension apparatus identificationinformation from the connected extension apparatus and transmits it tothe information processing device, and the information processing devicegenerates packet output data in accordance with the received extensionapparatus identification information.
 7. The communication system ofclaim 5, wherein the extraction scenario information is prestored in theextension apparatus, and the terminal device obtains extraction scenarioinformation from the extension apparatus when the extension apparatus isconnected to the terminal device.
 8. A terminal device for transmittingpacket input data to an information processing unit through packetcommunication according to a predetermined method for which format andcapacity are regulated, wherein an attachable and removable extensionapparatus is connected to the terminal device; said terminal devicecomprising: an operation input means for receiving an operation inputfrom a user; a packet generation means for making the operation inputdata obtained from the operation input means into a packet so as togenerate the packet input data; a storage means for storing integratedscenario information defining a region allotted for the extensionapparatus within data regions for the packet input data, and an extendeddata reception means for receiving extended input data from theconnected extension apparatus, wherein the packet generation meansgenerates the packet input data based on the integrated scenarioinformation when the extension apparatus is connected to the terminaldevice.
 9. The terminal device of claim 8, wherein the integratedscenario information defines a first input region allotted for theterminal device and a second input region allotted for the extensionapparatus within data regions for the packet input data, and the packetgeneration means, when the extension apparatus is connected to theterminal device, arranges the operation input data in the first inputregion defined in the integrated scenario information, arranges databased on the extended input data in the second input region defined inthe integrated scenario information, and then generates the packet inputdata.
 10. The terminal device of claim 9, wherein the packet generationmeans, when the extension apparatus is connected to the terminal device,generates fundamental input data corresponding to the predeterminedmethod by arranging the operation input data in the first input region,generates extended input data corresponding to the predetermined methodby arranging the extended input data in the second input region, and theintegrates the fundamental input data and the extended input data,thereby generating extension the packet input data.
 11. The terminaldevice of claim 8, wherein the integrated scenario information isprestored in the extension apparatus, and the terminal device obtainsintegrated scenario information from the extension apparatus when theextension apparatus is connected to the terminal device.
 12. A terminaldevice for receiving packet output data from an information processingunit through packet communication according to a predetermined methodfor which format and capacity are regulated, wherein an attachable andremovable extension apparatus is connected to the terminal device, saidterminal device comprising: a packet data processing means for executinganalysis processing of the received packet output data; and a storagemeans for storing integrated scenario information defining a regionallotted for the extension apparatus within data regions for the packetinput data, wherein when the extension apparatus is connected, thepacket data processing means extracts the extended output data for theextension apparatus from the packet output data based on the extractionscenario information, and then transmits the extracted extended outputdata to the extension apparatus.
 13. The terminal device of claim 12,wherein the extraction scenario information is prestored in theextension apparatus, and the terminal device obtains extraction scenarioinformation from the extension apparatus when the extension apparatus isconnected to the terminal device.
 14. A communication processing methodexecuted by a terminal device for transmitting packet input data to aninformation processing unit through packet communication according to apredetermined method for which format and capacity are regulated,wherein an attachable and removable extension apparatus is connected tothe terminal device; said communication processing method comprising thesteps of: receiving an operation input from a user; receiving extractioninput data from the extension apparatus when the extension apparatus isconnected to the terminal device; and generating packet input data, whenthe extended input data has been received, based on a integratedscenario defining a region allotted for the extension apparatus withindata regions for the packet input data.
 15. A communication processingmethod executed by a terminal device for receiving packet output datafrom an information processing unit through packet communicationaccording to a predetermined method for which format and capacity areregulated, wherein an attachable and removable extension apparatus isconnected to the terminal device, said communication processing methodcomprising the steps of: extracting extended output data for theextension apparatus from the packet output data based on an integratedscenario defining a region allotted for the extension apparatus withindata regions for the packet output data when the extended data isconnected; and transmitting the extracted extended output data to theextension apparatus.
 16. A non-transitory, computer readable storagemedium containing a communication processing program for making acomputer of a terminal device transmit packet input data to aninformation processing unit through packet communication according to apredetermined method for which format and capacity are regulated, andfor making the terminal device function as a packet generation means forgenerating the packet input data based on an integrated scenariodefining a region allotted for the extension apparatus within dataregions for the packet input data when an attachable and removableextension apparatus is connected to the terminal device.
 17. Anon-transitory, computer readable storage medium containing acommunication processing program for making a computer of a terminaldevice receive packet output data from an information processing unitthrough packet communication according to a predetermined method forwhich format and capacity are regulated, and for making the terminaldevice function as a packet data processing means for extractingextended output data for the extension apparatus from the packet outputdata based on an integrated scenario defining a region allotted for theextension apparatus within data regions for the packet output data whenan attachable and removable extension apparatus is connected to theterminal device.
 18. (canceled)